IN THE CLAIMS: 

Please cancel claims 2, 4, 6, 13-16, 18, 21-23 and 25 without prejudice to or 
disclaimer of the subject matter presented therein. 

Please amend claims 1, 3, 17, 19, 20 and 24, and add Claim 28 as follows. 

1 . (Currently Amended) An image processing device comprising: 

an image pick-up device having the a fixed positional relation with 
relationship with respect to a measurement object; 

an attitude orientation sensor for measuring the attitude orientation at an 
image pick-up visual point of said image pick-up device; 

a storage unit adapted to store the calculation information to calculate the 
attitude orientation and/or position of said measurement object on the basis of an output 
from said attitude orientation sensor; 

a target image setting unit adapted to s e t a target imag e that is an object fo r 
detecting a pred e t e rmined index on the basis of a picked-up image picked up by said image 
pick-up device obtain a prediction position of an index in an image picked-up by said 
image pick-up device using a measured value from said orientation sensor and said 
calculation information stored in said storage unit, generate an image with a peripheral area 
around said prediction position in said picked-up image subjected to a rotational process on 
the basis of a rotational angle in a roll direction of said image pick-up device derived from 
said measured value, and output said generated image as a target image ; 



a detecting unit adapted to detect the position of said index in said target 
image by performing a template matching process between a template image of said index 
and said target image; 

an updating unit adapted to update said calculation information stored in 
said storage unit on the basis of a detected position of said index detected by said detecting 
unit; and 

a calculation unit adapted to calculate the attitude orientation and/or 
position of said measurement object on the basis of said measured value and said 
calculation information updated by said updating unit. 

2. (Cancelled) 

3. (Previously Presented): The image processing device according to claim 
2 1, wherein said calculation information is the correction information to correct for an 
error in the measured value of attitude measured by said attitude sensor, and said 
calculation unit calculates the attitude of said measurement object on the basis of said 
measured value and said correction information. 

4. (Cancelled) 

5. (Previously Presented) The image processing device according to claim 
1, wherein said calculation information is the correction information to correct for an error 
in the measured value of attitude measured by said attitude sensor and the position 



information of the image pick-up visual point of said image pickup device, and said 
calculation unit calculates the position and attitude of said measurement object on the basis 
of said measured value, said correction information and said position information. 

6. (Cancelled) 

7. (Previously Presented) The image processing device according to claim 
5, wherein said updating unit updates the position information in the two directions except 
for a depth direction in the camera coordinate system of said image pickup device, even 
when an index of only a single point is detected in said detecting unit. 

8. (Previously Presented) The image processing device according to 
claim 3, wherein said correction information is the information to correct for an error in the 
azimuth direction among the measured values of the attitude measured by said attitude 
sensor. 

9. (Previously Presented) The image processing device according to 
claim 1, wherein said updating unit updates said calculation information on the basis of the 
detected position of said index in said picked-up image. 

10. (Previously Presented) The image processing device according to 
claim 3, wherein said updating unit updates said calculation information on the basis of a 
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typical value of the updated value of said calculation information obtained for each index 
when a plurality of indices are detected in said detecting unit. 

1 1 . (Previously Presented) The image processing device according to 
claim 3, wherein said updating unit updates said calculation information on the basis of a 
dislocation between the prediction position and said detected position of said index in said 
target image. 

12. (Previously Presented) The image processing device according to 
claim 11, wherein said updating unit updates said calculation information on the basis of a 
typical value of said dislocation obtained for each index when a plurality of indices are 
detected in said detecting unit. 

13. (Cancelled) 

14. (Cancelled) 

15. (Cancelled) 

16. (Cancelled) 

17. (Currently Amended) The image processing device according to 
claim 1, wherein said measurement object is an image pick-up visual point of said image 
pick-up device and said image processing device further comprises a display unit adapted 
to display said pick-up image with the image in the virtual space superposed thereon on the 



-5- 



basis of the orientation of position and orientation of said image pick-up device calculated 
bv said calculation unit . 



18. (Cancelled) 

19. (Currently Amended) The image processing device according to 
claim 1, wherein said measurement object is a visual point of the observer, and said image 
processing device further comprises a display unit for displaying adapted to display the 
image in the virtual space drawn on the basis of the attitude orientation or position and 
attitude orientation of the observer calculated by said calculation unit on said a display 
screen, while optically transmitting the image in the real space through said display screen 
observed by the observer. 

20. (Currently Amended) An image processing device in which the 
position of an index in a picked-up image picked up by an image pick-up device is detected 
by template matching employing a template image of said index, comprising: 

an attitude orientation sensor for measuring the orientation attitude at an 
image pick-up visual point of said image pick-up device; 

a target image creating unit adapted to create a target image having a 
peripheral area around a prediction position in said picked-up image subjected to a 
rotational process on the basis of the rotational angle in a roll direction from said measured 
value values by obtaining said prediction position of the index in said picked-up image, 
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using employing the measured value of said orientation attitude measured by said 
orientation attitude sensor, and outputting the target image; and 

a detecting unit adapted to detect the position of said index in said 
picked-up image by performing a template matching process between said template image 
and said target image. 

21. (Cancelled) 

22. (Cancelled) 

23. (Cancelled) 

24. (Currently Amended) An image processing method comprising: 

an image pick-up step, of picking up an image with an image pick-up device 
having a the fixed positional relationship with respect to r e lation with a measurement 
object; 

an orientation attitude measuring step, of measuring the orientation attitude 
at an image pick-up visual point of the image pick-up device; 

a storage step, of storing the calculation information to calculate the 
orientation attitude and/or position of the measurement object on the basis of the measured 
value measured in said orientation attitude measuring step; 

a target image setting step, of setting a target image that is an object for 
detecting a predetermined index on the basis of the picked-up image; 
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a detecting step, of detecting the position of the index in the target image by 
performing a template matching process between a template image of the index and the 
target image; 

an updating step, of updating the calculation information stored in said 
storage step, on the basis of a detected position of the index detected in said detecting step; 
and 

a calculating step, of calculating the orientation attitude and/or position of 
the measurement object on the basis of the measured value and the calculation information 
updated in said updating step. 

25. (Cancelled) 

26. (Previously Presented) A program code for executing the image 
processing method according to claim 24. 

27. (Previously Presented) A storage medium storing the program code 
according to claim 26. 

28. (New) An image processing method for use with an image processing 
device in which the position of an index in a picked-up image picked up by an image 
pick-up device is detected by template matching employing a template image of said index, 
said method comprising: 
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an orientation measuring step of measuring the orientation at an image 
pick-up visual point of the image pick-up device; 

a target image creating step of creating a target image having a peripheral 
area around a prediction position in the picked-up image subjected to a rotational process 
on the basis of the rotational angle in a roll direction from the measured value by obtaining 
the prediction position of the index in the picked-up image using the measured value of 
orientation measured in said orientation measuring step, and outputting the target image; 
and 

a detecting step of detecting the position of said index in said picked-up 
image by performing a template matching process between said template image and said 
target image. 



